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ABSTRACT 



A steganographic method is disclosed to embed an invisible 
watermark into an image. It can be used for copyright 
protection, content authentication or content annotation. The 
technique is mainly based on K-L transform. Firstly a block 
and cluster step 106 and cluster selection step 108 are 
performed to enhance the optimization of K-L transform 110 
for a given image. Then a watermark is embedded 114 into 
the selected eigen-clusters. ECC (Error Correction Code) 
can be employed to reduce the embedded code error rate. 
The proposed method is characterized by robustness despite 
the degradation or modification on the watermarked content. 
Furthermore, the method can be extended to video, audio or 
other multimedia especially for multimedia databases in 
which the stored multimedia are categorized by their con- 
tents or classes. 
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METHOD AND APPARATUS FOR ing steps: generating one or more transforms from the digital 

EMBEDDING DIGITAL INFORMATION IN multimedia data or a portion of the digital multimedia data, 

DIGITAL MULTIMEDIA DATA wherein said transforms are dependent on the digital mul- 
timedia data or the portion of the digital multimedia data; 
5 generating transformed digital multimedia data by applying 

FIELD OF INVENTION me one or more transforms to the digital multimedia data or 

the portion of the digital multimedia data; embedding the 

The present invention relates to a method and apparatus digital information in the transformed digital multimedia 

for embedding digital information in digital multimedia data; and generating the digital multimedia data embedded 

data. The invention also relates to a computer program with the digital information by applying one or more inverse 

product including a computer readable medium having transforms of the one or more transforms to the embedded 

recorded thereon a computer program for embedding digital transformed multimedia data, 

information in digital multimedia data. . ,. A L -n • A fl , • iL 

° According to still another aspect of the invention, there is 

BACKGROUND OF INVENTION provided a method of embedding digital information in 

1S digital multimedia data, wherein said method includes the 

Over recent decades there has been a rapid growth in following steps: generating one or more transforms from the 

computers and digital communications networks. With this ^1 multimedia data or a portion of me digital multimedia 

growth, the illegal distribuUoo duplication and the mampu- d wherein said transforms are depeDdent on the digital 

lation of digital or digitised multimedia content have multimedia data or the rtion of the multimedia 

become more and more common place. Even though such , 4 4 . A r . , iT^ j- j 4 • 

activity may violate copyright laws, it is still widespread. 20 data J generating transformed digital multimedia data by 

There is thus a need to protect the rights of owners who own *PPly*g the one or more transforms to the digital multune- 

these original multimedia data. dia data or the P orUoD of the dl S ltal multimedia data; 

„. , , , , .. r r , embedding the digital information in the one or more 

Similarly, there has also been a proliferation of exchange , - & t ,™ . , . 

of sensitive data over public communications networks. transforms or their inverses; and generating the digital 

Recently, digital signatures have been used to verify and 25 ™kimedia data embedded with the digital information by 

authenticate the integrity of such data and identity the sender applying one or more embedded inverse transforms to the 

of the data. However there exists a need for invisible digital transformed digital multimedia data, 

signature for images, which adequately represents the con- According to still another aspect of the invention, there is 

tent of the images and further can be used for verifying provided a method of embedding digital information in a 

whether the signed images have been modified. 30 digital image, wherein said method includes the following 

In addition, there has been an associated growth in steps: partitioning the image into blocks of pixels; clustering 

multimedia databases. Usually the stored multimedia data the partitioned blocks into classes according to a homoge- 

needs to be annotated (captioning). If the annotation can be neity criteria; selecting one or more of the clusters in 

associated with the content permanently, it will be conve- accordance with HVS analysis; generating an associated 

nient and safe for some applications such as medical image 35 Karhunen-Loeve (K-L) transform for each selected cluster, 

database. wherein the image blocks of each selected cluster are used 

Digital watermarking techniques can be applied to the as a vector population for the purposes of generating the 

above-mentioned applications, namely, for copyright associated K-L transform; applying the associated K-L 

protection, multimedia content authentication and multime- transform to the image blocks of the selected cluster to 

dia content annotation. Although visible watermarks have 40 produce corresponding transformed image blocks; 

been previously used, there is much promise for invisible embedding, for each selected cluster, the digital information 

digital watermarking techniques due to its unobtrusive m the associated K-L transform; and applying, for each 

nature. Regardless of particular applications, the following selected cluster, an inverse transform of the embedded 

are the basic and common requirements for invisible water- associated K-L transform to the transformed image blocks of 

marks. The watermark should be unobtrusive and not annoy- ^ ^ selected cluster 

ing to bona-fide users. The watermark scheme should be A . . 

? 1.1 j- . j- * j According to still another aspect of the invenuon, there is 

robust to some reasonable distortions during storage and ., , iU . f . ,.. , . c A 

. / 1 . r , provided a method of embedding digital information in a 

transmission (such as compression, noise addition, format *, . . , . , . . , , * « 

conversion, and bit errors). The watermark scheme should wher L em said meth l ° 1 d mclu f des * e following 

also be robust to some artifacts caused by signal processing ste P s: Phoning the image into blocks of pixels; clustering 

operations (such as noise reduction, filtering, sharpening, 50 the partitioned blocks into classes according to a homoge- 

and colour & intensity variations) It should also be secure neit y criteria; selecting one or more of the clusters in 

against typical attacks such as colluding pirates who com- accordance with HVS analysis; generating an associated 

bine multiple versions of the same multimedia content that Karhunen-Loeve (K-L) transform for each selected cluster, 

are stamped with different watermarks. Erasing the water- wherein the image blocks of each selected cluster are used 

mark or replacing the watermark by another watermark 55 as a vector population for the purposes of generating the 

should be technically difficult. associated K-L transform; applying the associated K-L 

Although these requirements are essential to practical transform to the image blocks of the selected cluster to 

applications, so far no one method or system is capable of produce corresponding transformed image blocks; 

fully satisfying the above conditions due to its so many embedding, for each selected cluster, the digital information 

unsolved problems and challenges. 60 in the selected transformed image blocks; applying, for each 

selected cluster, an inverse transform of the associated K-L 

transform to the embedded transform image blocks of the 

It is an object of the present invention to ameliorate one selected cluster. 

or more disadvantages of the prior art. According to still another aspect of the invention, there is 

According to one aspect of the invention, there is pro- 65 provided a method of embedding digital information in a 

vided a method of embedding digital information in digital digital image, wherein said method includes the following 

multimedia data, wherein said method includes the follow- steps: partitioning the image into blocks of pixels; clustering 
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the partitioned blocks into classes according to a homoge- video images including a plurality of frames, wherein said 
neity criteria; selecting one or more of the clusters in method includes the following steps: extracting one or more 
accordance with HVS analysis; generating an associated key frames from the video images; generating one or more 
Karhunen-Loeve (K-L) transform for each selected cluster, transforms from the key frames or a part thereof, wherein 
wherein the image blocks of each selected cluster are used 5 said transforms are dependent on the key frames or the part 
as a vector population for the purposes of generating the thereof; generating transformed key frames or part thereof 
associated K-L transform; applying the associated K-L by applying the one or more transforms to the key frames or 
transform to the image blocks of the selected cluster to the part thereof; embedding the digital information in the 
produce corresponding transformed image blocks; selecting, one or more transforms or their inverses; and generating the 
for each selected cluster, either the associated K-L transform 1Q key frames or part thereof embedded with the digital infor- 
or its corresponding transformed image blocks for embed- mation by applying one or more embedded inverse trans- 
ding; embedding, for each selected cluster, the digital infor- forms to the transformed key frames or part thereof, 
mation in the selected K-L transform or the selected trans- According to still another aspect of the invention, there is 
formed image blocks; applying, for those selected clusters in provided a method of registering an image, wherein the 
which the digital information has been embedded in the 15 method includes the following steps: extracting key points 
associated K-L transform, an inverse transform of the from the image and their invariant attributes; extracting 
embedded associated K-L transform to the transformed other global information from the image; aligning the 
image blocks of the selected cluster; and applying, for those extracted key points and their invariant attributes with the 
selected clusters in which the digital information has been global information; and encrypting the aligned information 
embedded in the transformed image blocks, an inverse 2Q to provide an image signature. 

transform of the associated K-L transform to the embedded According to still another aspect of the invention, there is 

transform image blocks of the selected cluster. provided a method of modifying a first image in accordance 

According to still another aspect of the invention, there is with an image signature, wherein the image signature 

provided a method of embedding digital information in a includes encrypted key points of a second image and their 

plurality of images, wherein the images are stored and 25 invariant attributes and other aligned global information of 

classified into one or more classes and said method includes the second image and the method includes the steps of: 

the following steps: generating one or more transforms from decrypting the image signature to obtain the key points and 

the images of said respective one or more classes, wherein their invariant attributes and other global information of the 

said transforms are dependent on the images; generating second image; extracting key points and their invariant 

transformed images by applying the one or more transforms 30 attributes from the first image; extracting other global infor- 

to the images of said respective one or more classes; mation from the first image; matching the key points and 

embedding the digital information in the transformed their invariant attributes and other global information of the 

images; and generating the images data embedded with the first and second images; and normalising the first image 

digital information by applying one or more inverse trans- based on said matched key points and their invariant 

forms of the one or more transforms to the embedded 35 attributes and other global information, 

transformed images. According to still another aspect of the invention, there is 

According to still another aspect of the invention, there is provided a method of extracting digital information from 

provided a method of embedding digital information in a first digital multimedia data having embedded therein said 

plurality of images, wherein the images are stored and digital information, wherein said method includes the fol- 

classified into one or more classes and said method includes 40 lowing steps: deriving one or more embedded transforms 

the following steps: generating one or more transforms from from a reference file, wherein said embedded transforms are 

the images of said respective one or more classes, wherein dependent on second digital multimedia data or a portion 

said transforms are dependent on the images; generating thereof; deriving transformed digital multimedia data from 

transformed images by applying the one or more transforms the reference file, wherein said transformed digital rnuiti- 

to the images of said respective one or more classes; 45 media data is dependent on the second digital multimedia 

embedding the digital information in the one or more data or a portion thereof; generating transformed digital 

transforms or their inverses; and generating the images multimedia data by applying one or more of the derived 

embedded with the digital information by applying one or embedded transforms to the first digital multimedia data or 

more embedded inverse transforms to the transformed a portion thereof; and correlating the generated transformed 

images. 50 digital multimedia with the derived transformed digital 

According to still another aspect of the invention, there is multimedia to check whether the digital information embed- 

provided a method of embedding digital information into ded in the first multimedia data is the same as that derived 

video images including a plurality of frames, wherein said from the reference file. 

method includes the following steps: extracting one or more According to still another aspect of the invention, there is 

key frames from the video images; generating one or more 55 provided a method of extracting digital information from 

transforms from the key frames or a part thereof, wherein first digital multimedia data having embedded therein said 

said transforms are dependent on the key frames or the part digital information, wherein said method includes the fol- 

thereof; generating transformed key frames or part thereof lowing steps: deriving one or more transforms from a 

by applying the one or more transforms to the key frames or reference file, wherein said transforms are dependent on 

the part thereof; embedding the digital information in the eo second digital multimedia data or a portion thereof; deriving 

transformed key frames or part thereof; and generating the transformed digital multimedia data from the reference file, 

key frames or part thereof embedded with the digital infor- wherein said transformed digital multimedia data is depen- 

mation by applying one or more inverse transforms of the dent on the second digital multimedia data or a portion 

one or more transforms to the embedded key frames or part thereof; generating embedded transformed digital multime- 

thereof. 65 cba data by applying one or more of the derived embedded 

According to still another aspect of the invention, there is transforms to the first digital multimedia data or a portion 

provided a method of embedding digital information into thereof; and correlating the generated embedded trans- 
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formed digital multimedia with the derived transformed digital message within digital multimedia content. However, 

digital multimedia so as to extract the digital information. for ease of explanation, the steps of the preferred method are 

According to still another aspect of the invention, there is described with reference to a method of embedding a 

provided a method of embedding digital information in a watermark within a still digital image. Though, it is not 

digital image, wherein said method includes the following * intended that the present invention be limited to the latter 

steps; partitioning the image into blocks of pixels; clustering method. For example, the invention may have application to 

the partitioned blocks into classes according to a homoge- embedding an identification message within other multime- 

neity criteria; selecting one or more of the clusters in dia content such as video, audio, print or film. The embedded 

accordance with HVS analysis; averaging, for each selected identification message can also be used for copyright 

cluster, the blocks of pixels; embedding, for each selected 30 protection, content authentication and content annotation 

cluster, the digital information in the averaged blocks; and without departing from the scope and spirit of the invention, 
replacing, for each selected cluster, the blocks with the 

embedded averaged block for that cluster. First Preferred Embodiments) 

According to still another aspect of the invention, there is FIG. 1 is a flow diagram of a method of embedding a 
provided a method of extracting digital information from an 15 watermark in a digital image according to a preferred 
image having embedded therein said digital information, embodiment. The method commences at step 100 and any 
wherein said method includes; partitioning the image into necessary initialisation processes are undertaken. In the next 
blocks of pixels; clustering the partitioned blocks into step 102, an original digital image is input by a user for 
classes according to a homogeneity criteria; selecting one or processing. The original digital image is a pixel-map rep- 
more of the clusters in accordance with information obtained 20 resentation which includes a numerical representation of the 
from a reference file; retrieving, for each selected cluster, an particular colour for each pixel location in a rectangular 
average block of pixels stored in the reference file; array. Any numerical representation of colour can be used 
averaging, for each selected cluster, the blocks of pixels of an d can be expressed as a sequence of one or more numbers, 
the image; and correlating, for each selected pixel, the Also, other information may be input at this stage, such as 
averaged blocks of the image with the retrieved blocks to 25 header information. Such header information can include the 
determine whether a watermark exists, s iz e of the image, resolution etc. 

According to still another aspect of the invention, there is input origioal image is then preprocessed in step 104. 

provided an apparatus for implementing any one of the xh e preprocessing may take the form of filtering, noise 

aforementioned methods. ^ estimation and so on. After the preprocessing step 104, the 

According to still another aspect of the invention there is method continues with a block and clustering step 106. 

provided a computer program product including a computer [n me block and catering step 106, the selected original 

readable medium having recorded thereon a computer pro- ^ divided into N non-overlapping blocks of size nxn. 

gram for implementing any one of the methods described Preferably, these blocks are either 4x4 pixels or 8x8 pixels 

aDOVe - 35 in size. In the event the original image is not a multiple of 

BRIEF DESCRIPTION OF THE DRAWINGS me image block size, a portion of the original image which 

„ . <• * • . t- isa multiple can be used by the method and the remaining 

Embodiments of the invention are described with refer- poftion disregarded m bIock ^ cluster st 106 aUocates 

ence to the drawings, in which: ^ image blocks tQ dust£rs (sometimes known as classes) 

FIG. 1 is a flow diagram of a method of embedding a 4Q accor ding to the details of the image block content and a 

watermark in a digital image in accordance with a preferred homogeneity criteria. Thus the image blocks within each 

embodiment; cluster will have similar amount of and type of content. 

FIG. 2 shows a copyright protection system for protecting Preferably, the clusters are classified according to their 

an owner's watermarked image in accordance with a pre- complexity or texture content. This classification is achieved 

ferred embodiment; 45 m the following manner. Firstly, feature measures are 

FIG. 3 is a flow diagram of a method of generating a extracted from each image block which are representative of 

reference file that can be used for both image registration the complexity of the content. Some preferred feature mea- 

and for image authentication in accordance with a preferred sure s are grey scale, colour variation or texture measures, 

embodiment; Afterwards, the clustering process classifies the image 

FIG. 4 is a flow diagram of a method of extracting a 50 blocks according to their feature measures. The clustering 

watermark from an image in accordance with a preferred process preferably utilises the k-means clustering method, 

embodiment. Alternatively, the preferred method can use region growing, 

FIG. 5 shows a flow diagram of a method of registering or split -merge clustering processes. In this way, the block 

and recovering an image for use in the extraction method and clustering step allocates the image blocks to a plurality 

shown in FIG. 4; 55 of clusters. After the block and clustering step 106 is 

FIG. 6 is a flow diagram of a method of embedding a completed, the processing continues at step 108. 

watermark in a digital image according to a second preferred In step 108, a cluster selection process is undertaken. In 

embodiment; this selection process, an analysis based on the Human 

FIG. 7 there is shown a watermark extracting method for Vision System (HVS) is applied to all clusters to determine 

extracting a watermark embedded in accordance with the <so whether and by how much the watermark can be embedded, 

method of FIG. 6; and Preferably, those clusters which satisfy the HVS require - 

FIG. 8 is a block diagram of a general-purpose computer ments are selected for watermark embedding. The percep- 

for implementing the preferred methods of FIGS. 1 to 7. ^al redundancies inherent in a still image are basically due 

nccrD1DTrnKT t0 inconsistency in the sensitivity of the HVS to stimuli of 

DETAILED DESCRIPTION 65 vary i ng levels of contrast and luminance changes in the 

The principles of the preferred method described herein spatial domain. Thus, by utilising the HVS model in the 

have general applicability to a method of embedding a preferred method it is possible to embed more information 
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while not overall affecting image quality. Or in other words, 
the embedded watermark information is invisible to human 
eyes. In the preferred method, the HVS model is used to 
select the clusters and the embedding strength. For example, 
the embedding strength is determined as a proportion of the 5 
contrast of the image content of the cluster. Preferably, the 
HVS model used is that described in the paper "A percep- 
tually tuned subband image coder based on the measure of 
Just-Noticeable-Distortion profile" by C. H. Chou and Y. C. 
Li, IEEE Trans. On circuits and Systems for Video 
Technology, Vol. 5, No. 6, pp467-476, 1995 (herein incor- 
porated by reference). In another embodiment, if there are a 
number of clusters which satisfy these HVS requirements, 
then one or more clusters can be selected by the user for 15 
embedding. Alternatively, different clusters can be embed- 
ded with different watermarks with the same seeds to 
increase the security and robustness of the watermarking. 
After the clusters have selected the preferred method pro- 
ceeds to the next step 110. 20 

In the next step 110, one or more Karhunen-Loeve trans- 
forms (KLI) are applied to the image blocks of one or more 
selected clusters. These KLT transforms are each derived 
from and applied to a corresponding selected cluster. It is 25 
noted that, up until today, the statistically optimum, signal- 
dependent transform, KLT is still believed to be impractical 
for image processing. This is due to the time-consuming 
computations needed for determining the data covariance 
matrix (related to eigen-vectors). However in the preferred 30 
method, this will not be a crucial problem any more. Firstly, 
the KLT adopted in the preferred method is the discrete KLT 
(also called the Principle Components Analysis) where there 
have been some fast implementations developed recently. 
Secondly, unlike image compression or image coding, for 35 
watermarking there is no need to transform all blocks or 
segmented regions in the images. The fast clustering pro- 
cessing associated with the cluster selection step 106 allows 
the reduction of the computational burden to an acceptable 
and practical level. Namely, the KLT transforms need not be 40 
applied over all the image, but only to the selected clusters. 

In the step 110, a KLT transform is separately derived and 
applied for each cluster. Firstly, each non-overlapping block 
in the i th cluster (segment), i=l, A, N, is mapped to a 45 
d-dimensional vector X ip where d-3n 2 , by sequentially 
scanning each location in the block and taking its corre- 
sponding tricomponent colour signals. (Note: for mono- 
chrome image, d-n 2 ). Here N denotes the total number of 
clusters to be transformed. Thus each block in the same 50 
cluster can be implicitly modelled as separate multivariate 
Gaussian Markov random fields. The sets of vectors X (J 
created in this way are assumed to have jointly zero-mean 
Gaussion distributions. The dxd covariance matrix R ( of 
each such stationary zero-mean Gaussion source, i«l, A, N, 55 
is estimated as 



0) 



60 



Where M,- corresponds to the number of blocks in the ith 
cluster. The preferred method then calculates Eigenvalues of 
the covariance matrix R.- in accordance with 65 
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Where t ik is the kth eigenvector (k=l, K, p)of the ith cluster 
and \ ik is its corresponding eigenvalue. The eigenvectors 
calculated from (2) are orthonormal, ie., 



(3) 
(4) 



Subsequently, the eigenvectors are arranged such that 
^n— K-z— ^— \d anc * tne fi 1 ^ 1 eigenvectors, where L^d, 
can be used to form the transform matrix A,=[ e ii c i2 A e^] 7 ^ 
where d is the dimension of vector X t> . Preferably however, 
all the eigenvectors are used to form the transform matrix, 
viz L,-=d. The reason for the latter is that the preferred 
method is primarily concerned with watermarking and not 
compression. Each vector X t y from the ith image cluster can 
then be processed by the linear transform: 



(5) 



After step 110, the preferred method proceeds to the next 
step 112. In step 112, a user decides whether the watermark 
is to be embedded in either the eigenvector domain A,- or the 
coefficients of vectors Y, y . Preferably, the user selects either 
the eigenvector domain A,- or the coefficients of vectors Y £J 
for the entire image, viz for all clusters. However in another 
embodiment, the user is able to select the eigenvector 
domain A^ for one cluster and the coefficients of vectors Y if 
for another cluster. This will result in benefits in the security 
of the watermarking method. In a still further embodiment, 
the method automatically and exclusively embeds the water- 
mark in the eigenvector domain A,-. Namely, the selection is 
automatic and no input from a user is required. Similarly, the 
method can automatically and exclusively embed the water- 
mark in the coefficients of vectors Y, y . In still further 
embodiment, the actual selection process is dependent on 
the requirements of the particular application. After step 112, 
the method continues processing at step 114. 

In step 114, the method embeds the watermark in the 
selected domain, namely either the eigenvector domain A, or 
the coefficients of vectors Y iy . In the event the preferred 
method embeds the noise -like watermark into the coefficient 
domain, the following embedding process is performed, A 
property of the coefficients of the vectors Y if are that they are 
completely uncorrelated, as can be seen from eqn (6). 



Xu 0 A 0 

0 Af 2 A 0 

M M M M 

0 0 A Air, 



(6) 



where \ n ='k i2 =A^X UJ and are the eigenvalues of the cova- 
riance matrix R,-. The preferred method embeds the water- 
mark in the first L ( - coefficients of each vector Y t y where 



L.^rg tnax{k ikt 'Kk= D i 



(7) 



(2) 



The parameter in (7) represents the allowed distortion 
within the cluster. Its value will be defined for each cluster 
separately and decided by the results of HVS analysis. Thus 
during this embedding process the vectors Y tf are changed to 

In the event the preferred method embeds the noise-like 
watermark into the eigenvector domain, the watermark will 
be embedded into the first L, eigenvectors of A,- in accor- 
dance with eqn (7). Thus during this embedding process the 
transform A, is changed to A,. As the eigenvectors of the 
transform matrix are orthogonal to each other, the generated 
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watermark W, should be orthogonalized with respect to the 
eigenvectors before embedding. 

In another embodiment, the transform A, may be first 
inverted and then embedded with the watermark. 

All the parameters of the selected domain are embedded, 5 
by modulating the parameters by a noise-like watermark. 
This modulation is achieved in the following way 



(«) 



XiTA^Yqhl&Mt (10) 

Where the watermark has been embedded in the coeffi- 
cients of the vectors, the inverse KLT is applied to the 
embedded vectors. Thus the watermark image blocks are 
transformed by 



10 



Where f is a function of watermarking modulation, P and P 
are parameters after and before watermarking, and PN(W) is 
generated noise-like watermark. 

The content of image itself, the owner's private key of an 
encryption algorithm, embedding time or other information 15 
related to the owner or the buyer can be used to form the 
seeds of the embedded watermarks. Furthermore error cor- 
rection encoding can be used to increase the robustness of 
the preferred method. The preferred method can use any one 
of a number of typical methods to embed a watermark 2Q 
(modulation). A simple example of such a embedding 
method is as follows 



(9) 



After the completion of the watermark embedding step 25 
114, the process continues at step 116. In step 116, the 
respective inverse KLT transforms are separately applied to 
their respective clusters. Where the watermark has been 
embedded in the eigenvector domain, the "embedded" 
inverse KLT transform is applied to the vectors. Thus the 30 
watermarked image blocks are transformed by 



35 



(11) 



40 



These resultant image blocks form the basis of the water- 
marked image. To retrieve the watermark from the water- 
mark image or to authenticate the watermark image a 
reference file is needed. This reference file may be the 
original image itself or data based on the original image. 45 
Such data can include the size of the image, the resolution, 
the clusters selected and their associated KLT transform, 
modulation technique and owner information. 
Consequently, after the original image is preprocessed in 
step 104, the preferred method stores 122 the original image 50 
or the derived data as the reference file. In step 122, the 
reference file is normally held in a secure location and 
maybe encrypted. 

After completion of inverse transform KLT 116, the 
preferred method continues at step 118, where the water- 55 
marked image is output. The method terminates at step 118. 

The use of the KLT transform as the watermark embed- 
ding domain has the following advantages. Firstly, the KLT 
transform is a kind of signal-dependant transform. That 
means the watermark to be embedded will follow any 60 
changes of image content. Even if the watermark is the same 
for all different images, the real form of the embedded 
watermark is different. Thus in this sense, the embedded 
digital watermark is dependent upon the image content and 
can be used to authenticate an image. Furthermore, whilst 65 
the type of transform used to generate the image may be 
known, the original watermark cannot be defeated by 



10 



inverse transforming the watermarked image data to derive 
the original data, since this involves the use of a different 
inverse transform. That is, because the watermarked data is 
different from the original data. Likewise, attempts to 
fraudulently claim ownership on image data already water- 
marked by the preferred method will be defeated because a 
different optimal transform dependent upon the water- 
marked image data will be involved. Still further, the KLT 
transform presents an extra choice to select the embedding 
locations either in the eigen-vector domain (basis function of 
KLT transform) or in the coefficient domain of KLT trans- 
form. This means that watermarking based on KLT can be 
done in a much secure and flexible way than other methods. 
In addition, the KLT transform can provide a more effective 
energy-compact ability more than any other transform such 
as DCT, DST, FFT, etc. As there is significant redundant 
information contained in an image, applying a KLT trans- 
form to an image means that there is more space for 
embedding the watermark. Also, unlike most of common 
watermarking schemes which only embed the watermark 
into the luminance channel, the KLT transform can directly 
& jointly process colour images. It presents a flexible way 
to embed a watermark directly into all colour channels. In 
addition, the embedded messages will persist through image 
modifications such as scaling, rotating, printing-rescanning, 
colour & intensity variation. 

Turning now to FIG. 2 there is shown a copyright pro- 
tection system for protecting an owner's watermarked image 
in accordance with a preferred embodiment. Firstly, the 
owner of the image 200 sends his request 201 to a Copyright 
Management Centre (CMC) 202 for registration. The CMC 
202 provides the owner of the image 200 with a watermark 
embedding tool 203 to embed his private watermark in his 
images 205. During this procedure, a reference file 206 is 
generated and sent to CMC 202. The reference file 206 is 
based on a content analysis 207 of the owner's image 205. 
After watermarking 204, the CMC 202 will activate an 
Internet Spider 208 to protect the owner's watermarked 
images 210. Of course, there are so many variant applica- 
tions related to copyright protection, content authentication 
and content annotation. Preferably, the watermarking engine 
is that described with reference to FIG. 1, namely the 
watermarking engine is based on KLT transforms. This 
watermarking engine can be constructed as a kernel and 
integrated into various copyright protection systems either 
for public use or for private use. 

Turning now to FIG. 3, there is shown a flow diagram of 
a method of generating a reference file that can be used for 
both image registration and for image authentication. This 
method of generating a reference file may be used in the 
method of watermarking an image as shown in FIG. 1. The 
method commences at step 300 and continues at steps 302 
and 304 where an image is input and preprocessed. In the 
next step 306, the method summarises and extracts some key 
points of the preprocessed image. These key points must be 
invariant to some typical modifications such as affine 
distortions, colour or intensity changes etc. Alternatively, 
some variations of the key points can be allowed by adopting 
a global affine matching algorithm in the registration pro- 
cedure. Then the invariant attributes are calculated 308. 
These attributes are associated with other relative informa- 
tion such as maximum and minimum colour values, clusters 
and the number of clusters, and KLT transform matrices etc. 
Finally this associated information is encrypted by some 
cryptography algorithms 310 to form the reference file 312. 
The method terminates at step 314. In this way, the water- 
marked image is registered with reference to the properties 
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of the original image, which can be used in the method of normalisation method can be thai which is described in J. 
extracting the watermark from the watermarked image. Flusser, "An adaptive method for image registration", Pat- 
Alternatively, the reference file can be used for proving tem Recognition, Vol 25, No. 1, pp45-5 4, 1992. The method 
whether and by how much the watermarked image has been normalises the tested image by extracting the key content 
tampered with. 5 fr om (he tested image, measuring the modified parameters of 
Turning now to FIG. 4, there is shown of a watermark mc tcsted ^age with rc f cre nce to the reference file and then 
extracting method in accordance with a preferred embodi- normalising the tested image with respect to these modified 
ment. The method commences at step 400, where any parameters 

necessary parameters are initialised. In the next step 402, a ^ ^ ^cmion is suitable for use in a number of 

watermarked image is input by a user for watermark extrac- ^ \ , , . , 4l _ 

Af . j ■ . aaa *l *i_ * * c 10 different and widely varying applications, such as the cop y- 

Uon. Afterwards in step 404, the user then inputs a reference . , A A 4 . ; . .. ... r 

file 403 of the original image and/or associated parameters n § ht P ro ^ Uon s y stem f P re ™ usl y described. This system 

of the type as previously described. The watermarked image can P r0Vld f an approach to track subsequent use of digital 

is then normalised 406 based on the parameters retrieved and then P resent evidence for copyright protection, 

from the reference file 403. This normalised image is or alternatively provide a display warning users, 

partitioned into blocks 106 and then clustered 108, in a 15 The present invention also can be used for content authen- 

similar manner as the watermarking procedure as described tication. In this application, after summarising the image, the 

with reference to FIG. 1. In step 108, any parameters extracted key description about the image can be encrypted 

necessary for the selection of the clusters are retrieved from by the owner's private key. The buyer can then verify the 

the reference file 403. After step 108, the method continues authenticity of the image by using a public key. Based on the 

with step 408 where the relevant domain is selected from 20 rule-based image registration method, the results of the 

data from the reference file. In the case where the domain authentication include the information about not only 

selected is the coefficient domain, the next step 410 applies whether the given image is altered or not, how much it is 

the transform A,- to selected image blocks X„ of the test altercd > but ^° which kind of modification the said image 

u* * ,u az ■ * c * <r tt. • undergoes. The application may also inform the owner of the 

image to obtain the coefficients of vectors Y l7 . The images . t_ • j * , ^ < . , , 

, t r 25 images what kinds of attacks others have used on his or hers 

blocks X, y of the test image are decided by the reference file images A signature may also be embedded into the 

or owner's private key. The transform A, is also obtained imag£ for verifying the authenticity of the content provider, 

from the reference file. Finally, a correlation 412 is under- In additioilj the present invention also can be used for 

taken between the last mentioned coefficients of vectors Y, y content annotation. It is believed that the annotation done by 

and the coefficients of vectors Y fy obtained from the refer- 30 watermarking will be helpful for multimedia database based 

ence file and the watermark is extracted. The extracted 0 n the current technologies. 

watermark is then compared with the watermark obtained The present invention is also particularly suitable for 
from the reference file. In the case where the domain watermarking the images that has been stored in the multi- 
selected is the transform domain, the step 410 applies the media database no matter what kind of applications it is used 
embedded transform A, to selected image blocks X,y of the 35 for (copyright protection, authentication and annotation). As 
test image to obtain the coefficients Y ( y. A correlation 412 is in this case, the image will belong to some classes or 
then undertaken between the last mentioned coefficients of categories. For example, a face database in the police 
vectors Yfy and the coefficients of vectors Y,y obtained from station, thus a optimal basis matrix of KLT can be obtained 
the reference file so as to check whether there exists a based on the whole images from a class. The images are then 
watermark. If the coefficients are the same then the water- 40 embedded in a similar manner as described with reference to 
mark is the same as was originally embedded. The extracted FIG. 1. In this way, it is very difficult for the users or the 
watermark is then output in step 418 and the method then attackers to compute out the exact basis matrix. Without the 
terminates. exact basis matrix, it is unlikely to decode or to remove the 

Turning now to FIG. 5 there is shown a flow diagram of embedded watermark, 
a method of registering and recovering an image for use in 45 Furthermore, the present invention can be used in relation 
the extraction method shown in FIG. 4. As a watermarked to other media such as video and audio. For instance, in a 
image may undergo some modifications during it's lifetime, video file, there is a strong relationship between consecutive 
an operation like image registration is used to estimate the frames. A technique called key frame extraction has been 
modification parameters of the watermarked image. The shown to be an effective approach to video indexing or 
method commences at step 500 and continues at step 502 50 summarising. By applying the KLT to hide the information 
where a watermarked image is input. The watermarked directly into video file, the optimal basis matrix of the KLT 
image is then preprocessed 504 and summarised 506 to can be computed out not only based the clustered blocks 
obtain some key features or points. Once these key points within each frame but also based on frames represented by 
are optimally selected, their invariant feature attributes are the same key frame. Based on KLT, the data hiding can be 
computed. Meanwhile relative parameters are obtained from 55 implemented in a more secure and flexible way. 
the reference file 508 by an information recovering proce- „ , „ „ , „ , , v 
dure such as decryption. Such a reference file may be Second Preferred Embodiments) 
obtained by a method as described with reference to FIG. 3. FIG. 6 is a flow diagram of a method of embedding a 
In the next step, a rule-based global optimal search 510 is watermark in a digital image according to a preferred 
undertaken between the obtained invariant feature attributes 60 embodiment. The method commences at step 100 and any 
of the watermarked image and reference file. For example, necessary initialisation processes are undertaken. In the next 
if some feature points within a neighbour are missed, then a step 102, an original digital image is input by a user for 
chopping operation may be applied onto the watermarked processing. The original digital image is a pixel-map rep- 
image. The matching is mainly based on their invariant resentation which includes a numerical representation of the 
moments of the detected feature points. Based on the esti- 65 particular colour for each pixel location in a rectangular 
mated parameters, the watermarked image is the normalised array. Any numerical representation of colour can be used 
512 to recover an image similar to the original image. The and can be expressed as a sequence of one or more numbers. 
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Also, other information may be input at this stage, such as 
header information. Such header information can include the 
size of the image, resolution etc. Steps 102 to 108 of this 
method are the same as those described with reference to 
steps 102 to 108 of FIG. 1 and will not be described further. 

In step 602 of the method, the image blocks of each 
cluster i are averaged. These averaged blocks are each then 
embedded 604 with a watermark. An average (mean) block 
for Mi image blocks B,y (j =1,2, ... M) that belong to cluster 
i is determined by 



l ^ 



(12) 



and a difference block is obtained by 



(13) 



The average block can be used to embed the watermark if 
it satisfies the HVS condition. If there are more than one 
suitable clusters then the user can select the cluster used for 
embedding. The averaging and embedding process is 
described in more detail below with reference to the fol- 
lowing alternative embodiments. 

In the first embodiment, the embedding is achieved by an 
orthogonalization process. Firstly, the average mean block 
B ( is aligned as a (nxn)xl vector. This averaged mean block 
B ( is saved to a reference file for subsequent watermark 
extraction. The initial watermark W, then is orthogonalized 
with respect to B ( to obtain the final watermark Wj in 
accordance with the following: 



25 



30 



(14) 



where "B ( is the unit vector along B,. 
Next, a smaller scaled version of W is added back to B ( - to 
obtain a watermarked average block B,- in accordance with 
the following: 

Bi^Bj+cWj, where c is a small constant to contiol the strength of 
the watermark. (15) 

Finally in step 606, all the image blocks of the cluster are 
replaced with the watermarked average block B, to recon- 
struct a new image (watermarked image). The cluster criteria 
is chosen (108) so that the distortion caused by replacing all 
the image blocks within the cluster with the watermarked 
average block would be invisible to the human eye. 

In the second embodiment, the embedding is achieved by 
a spread spectrum process. In this embodiment, the average 
mean block B ( is first aligned as a (nxn)xl vector. The initial 
watermark W f is shaped to the same nxn length and with 
gaussian distribution (zero mean value). A small scaled 
version of W f - is added back to B,- to obtain a watermarked 
average block B ( - in accordance with the following: 

B l =B,-{l+cW^) J where c is a small constant to control the strength 
of the watermark. (1 6) 

Finally in step 606, all the image blocks of the cluster are 
replaced with the watermarked average block B t to recon- 
struct a new image (watermarked image). The cluster criteria 
is chosen (108) so that the distortion caused by replacing all 
the image blocks within the cluster with the watermarked 
average block would be invisible to the human eye. 

After the completion of step 606, the watermarked image 
is outpoured and the process terminates at step 610. 



35 



40 



45 



55 



65 
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Turning now to FIG, 7, there is shown a watermark 
extracting method for extracting a watermark embedded in 
accordance with the method of FIG. 6. The method com- 
mences at step 700, where any necessary parameters are 

S initialised. The test image is then input 102, preprocessed 
104 and block and clustered 106 in a similar manner as that 
of the embedding method of FIG. 6. After completion of step 
106, one or more clusters are selected for processing. The 
clusters selected are determined from information stored in 

10 the reference file 714. These clusters correspond to those 
selected in the embedding method. In the next step 706, the 
average mean block H,. is obtained from the reference file. In 
this step, the watermark W,- is also generated by the owner's 
key. The average mean block (from the reference file) is 

15 then aligned as a (nxn)xl vector. The watermark W f is then 
orthogonalised with respect to B, to obtain the original 
watermark in accordance with the following: 



20 



W*-Wr(WrBi)~Bi where 
~Bj is the unit vector along B,. 



(17) 

Similarly in the next step 708, a watermarked mean block J ( 
is then obtained from the test image. In the event, the 
watermark has been embedded by the orthogonal process, 
then watermarked mean block J ; is orthogonalised with 
respect to B, to obtain another vector X t . Finally in step 710, 
a correlation is undertaken between W f and X, to check 
whether the watermark exists. In the event, the watermark 
has been embedded by the spread spectrum process, then the 
DC component of J ( is removed. In this case a correlation is 
undertaken between W f - and J,- to check whether the water- 
mark exists. After the correlation is completed the method 
terminates at step 712. 

In a still further embodiment, the method of embedding 
and extraction of the second preferred embodiment may 
include a method of registering and recovering an image as 
shown in FIGS. 3 and 5. In this way, modifications that may 
subsequently occur to the embedded image are compensated 
by normalisation. In a still further embodiment, the first and 
second preferred embodiments may form part of the same 
watermarking engine. In the latter embodiment, a user's key 
is used to select the watermarking method to be used on a 
particular image. The user's key is an encrypted random key, 
which is divided into three parts. The first part is used to 
select the watermarking embedding space (mean block, the 
transform or vector coefficients), the second is used to select 
the watermark extraction method (eg. de -orthogonalization 
or correlation) and the third part is used as the seed to 
generate the initial watermark W f . In addition, the user's key 
can be used to select the cluster from the one or more 
clusters that meet the HVS criteria. 

Preferred Embodiment of Apparatus(s) 

The methods of FIGS. 1, 3, 4, 5, 6 and 7 is preferably 
practiced using a conventional general-purpose computer, 
such as the one shown in FIG. 8 wherein the processes of 
FIGS. 1, 3, 4, 5, 6 and 7 may be implemented as software 
executing on the computer. In particular, the steps of meth- 
ods of embedding and extracting a watermark are effected by 
instructions in the software that are carried out by the 
computer. The software may be divided into two separate 
parts; one part for carrying out the extraction and embedding 
methods; and another part to manage the user interface 
between the latter and the user. The software may be stored 
in a computer readable medium, including the storage 
devices described below, for example. The software is 
loaded into the computer from the computer readable 
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medium, and then executed by the computer. A computer device, a computer readable card such as a PCMCIA card, 
readable medium having such software or computer pro- and the Internet and Intranets including email transmissions 
gram recorded on it is a computer program product. The use and information recorded on websites and the like. The 
of the computer program product in the computer preferably foregoing are merely exemplary of relevant computer read- 
effects an advantageous apparatus for extracting and embed- s a bl e mediums. Other computer readable mediums may be 
ding a watermark in accordance with the embodiments of practiced without departing from the scope and spirit of the 
the invention. invention. 

The computer system 800 consists of me computer 802, ^ for m Qm a ^ numbef of embodi . 

a v.deo display 816, and. nputdevrces 818, 820. In addition, ^ of & e mventi hQ modifications 

the computer systeo , 800 ^an have any of a number of other io g ^ ^ ^ & ^ 

outou devices including line pnnters, laser printers, plotters, ^ d ^ from ^ ^ irft of ^ 

and other reproduction devices connected to the computer Fof exa ^ ^ d d transforms other 

802. The computer system 800 can be connected to one or ^ ^ transform £ ma 6 used £ the ferred methods . 

more other computers via a communication interface 8086 ^ t embodiments ^ t0 be c^id,.^ m 

using an appropnate communication channel 830 such as a 15 „ . . , .„ # 4 . , # t . t . 

rr r . t t ( all respects to be illustrative and not restrictive, 

modem communications path, a computer network, or the . 

like. The computer network may include a local area net- ^T 1 ^ ? lami£ ; d 1S \ r 

work (LAN), a wide area network (WAN), an Intranet, V A method of embedding .digital information ^in digital 

and/or the Internet multimedia data, wherein said method includes the follow- 

_ „ . . . . , .20 ing steps: 

The computer 802 itself consists of a central processing 

unit(s) (simply referred to as a processor hereinafter) 804, a generating one or more transforms from the digital mul- 

memory 806 which may include random access memory timedia data or a portion of the digital multimedia data, 

(RAM) and read-only memory (ROM), input/output (IO) wherein said transforms are dependent on the digital 

interfaces 808a, SOSb & 808c, a video interface 810, and one multimedia data or the portion of the digital multimedia 

or more storage devices generally represented by a block 25 data; 

812 in FIG. 8. The storage device(s) 812 can consist of one generating transformed digital multimedia data by apply - 

or more of the following: a floppy disc, a hard disc drive, a ing the one or more transforms to the digital multime- 

magne to-optical disc drive, CD-ROM, magnetic tape or any dia data or the portion of the digital multimedia data; 

other of a number of non-volatile storage devices well embedding the digital information in the transformed 

known to those skilled in the art. Each of the components digital multimedia data; and 

804 to 812 is typically connected to one or more of the other generating the digital multimedia data embedded with the 

devices via a bus 814 that in turn can consist of data, address, j:„j.„i • c„ l„ „ i .„■ „„„ „. _ • 

' digital information by applying one or more inverse 

an con to uses. transforms of the one or more transforms to the embed- 

The video interface 810 is connected to the video display 3J ded transformed digital multimedia data; 
816 and provides video signals from the computer 802 for wh6rein said ^ ^ multimedia data is „ ■ and said 
display on the video display 816. User input to operate the one Qr mQre , ransforms are K arhunen-Loeve trans- 
computer 802 can be provided by one or more tnput devices forms and said Mo[m&tioo is emb edded in the 
808ft. For example, an operator can use the keyboard 818 filst L coefficients of me transformed di gita i mu i tirne . 
and/or a pointing device such as the mouse 820 to provide 40 ^ data> where mf , number L ^ determined in accor . 
mput to the computer 802. ^ ^ Hys 

The system 800 is simply provided for illustrative pur- 2. A method as claimed in claim 1, wherein the method 

poses and other configurations can be employed without further comprises the following steps for selecting said 

departing from the scope and spirit of the invention. Exem- portion of said digital multimedia data: 

Plary computers on which the embodiment can be practiced 45 partitioning the ^ mt0 blocks; 

include IBM-PC/ATs or compatibles, one of the ^cimosh ^ ^ tioaed blocks iDto class6S according 

(TM) family of PCs Sun Sparcstation (TM), or die like. The to a n eneit edtet ^ ^ 

foregoing are merely exemplary of the types of computers , ^ . , ^ . . 

with which the embodiments of the invention may be selectmg one or more of the clusters as said portion of said 

practiced. Typically, the processes of the embodiments, 50 distal multimedia data m accordance with HVS analy- 

described hereinafter, are resident as software or a program „ „ 

recorded on a hard disk drive (generally depicted as block 3 - A method fanned in claim 2 ^herein the selecting 

812 in FIG. 8) as the computer readable medium, and read » to P, B determined in accordance with HVS analysis and a 

and controlled using the processor 804. Intermediate storage use / s ^ ec on - 

of the program and pixel data and any data fetched from the ss . * A meth ? d as clauned 1 m cla,m l > wherem 841(1 

network may be accomplished using the semiconductor informauon is a watermark. 

memory 806, possibly in concert with the hard disk drive A ' " d"™* * <*aim *> wherein said method 

further includes the following step: 

In some instances, the program may be supplied to the sloriD S al timedia data as a reference file 

user encoded on a CD-ROM or a floppy disk (both generally 60 £ ™ th f^tfd information, 

depicted by block 812 ), or alternatively could be read by the ft * met l h ° d m claim 1, wherein said method 

user from the network via a modem device connected to the farthcr mcludcs the following steps 

computer, for example. Still further, the software can also be extracting invariant representations of the image; 

loaded into the computer system 800 from other computer storing said extracted representations together with asso- 

readable medium including magnetic tape, a ROM or inte- 65 ciated information in a reference file, 

grated circuit, a magneto-optical disk, a radio or infra-red 7. A method as claimed in claim 1, wherein said method 

transmission channel between the computer and another further includes the following steps 
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extracting key features from said image; and 
storing the key features together with associated informa- 
tion. 

8. A method as claimed in claim 7, wherein said key 
features include: the positions of the key features, invariant 
attributes of the key features, maximum and minimum 
colour values of the image, the size of the image. 

9. A method as claimed in claim 1, wherein said digital 
information is a copyright notice. 

10. A method as claimed in claim 1, wherein said digital 
information is an annotation of said digital multimedia data. 

11. A method as claimed in claim 1, wherein said digital 
information is authentication information verifying said 
digital multimedia data. 

12. A method of embedding digital information in digital 
multimedia data, wherein said method includes the follow- 
ing steps: 

generating one or more transforms from the digital mul- 
timedia data or a portion of the digital multimedia data, 
wherein said transforms are dependent on the digital 
multimedia data or the portion of the digital multimedia 
data; 

generating transformed digital multimedia data by apply- 
ing the one or more transforms to the digital multime- 
dia data or the portion of the digital multimedia data; 

embedding the digital information in the one or more 
transforms or their inverses; and 

generating the digital multimedia data embedded with the 
digital information by applying one or more embedded 
inverse transforms to the transformed digital multime- 
dia data. 

13. A method as claimed in claim 12, wherein said digital 
multimedia data is an image. 

14. A method as claimed in claim 12, wherein the method 
further comprises the following steps for selecting said 
portion of said digital multimedia data: partitioning the 
image into blocks; 

clustering the partitioned blocks into classes according to 
a homogeneity criteria; and 

selecting one or more of the clusters as said portion of said 
digital multimedia data in accordance with HVS analy- 
sis. 

15. A method as claimed in claim 14, wherein the select- 
ing step is determined in accordance with HVS analysis and 
a user's selection. 

16. A method as claimed in claim 12, wherein said 
transform is a Karhunen-Loeve transform. 

17. A method as claimed in claim 12, wherein said digital 
multimedia data is an image and said one or more transforms 
are Karhunen-Loeve transforms and said digital information 
is embedded in the first ^eigenvectors of the Karhunen- 
Loeve transforms, where the number h t is determined in 
accordance with HVS analysis. 

18. A method as claimed in claim 12, wherein said digital 
information is a watermark. 

19. A method as claimed in claim 12, wherein said method 
further includes the following step: 

storing the digital multimedia data as a reference file 
together with associated information. 

20. A method as claimed in claim 13, wherein said method 
further includes the following steps 

extracting invariant representations of the image; 
storing said extracted representations together with asso- 
ciated information in a reference file. 

21. A method as claimed in claim 13, wherein said method 
further includes the following steps 
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extracting key features from said image; and 
storing the key features together with associated informa- 
tion. 

22. A method as claimed in claim 21, wherein said key 
features include: the positions of the key features, invariant 
attributes of the key features, colour values of the key 
features, maximum and minimum colour values of the 
image, the size of the image. 

23. A method as claimed in claim 12, wherein said digital 
information is a copyright notice, 

24. A method as claimed in claim 12, wherein said digital 
information is an annotation of said digital multimedia data. 

25. A method as claimed in claim 12, wherein said digital 
information is authentication information verifying said 
digital multimedia data. 

26. A method of embedding digital information in a digital 
image, wherein said method includes the following steps: 

partitioning the image into blocks of pixels; 

clustering the partitioned blocks into classes according to 

a homogeneity criteria; 
selecting one or more of the clusters in accordance with 

HVS analysis; 

generating an associated Karhunen-Loeve (K-L) trans- 
form for each selected cluster, wherein the image 
blocks of each selected cluster are used as a vector 
population for the purposes of generating the associated 
K-L transform; 

applying the associated K-L transform to the image blocks 
of the selected cluster to produce corresponding trans- 
formed image blocks; 

embedding, for each selected cluster, the digital informa- 
tion in the associated K-L transform; and 

applying, for each selected cluster, an inverse transform of 
the embedded associated K-L transform to the trans- 
formed image blocks of the selected cluster. 

27. A method as claimed in claim 26, wherein said digital 
information is embedded in the first L,- eigenvectors of the 
Karhunen-Loeve transforms, where the number 1^ is deter- 
mined in accordance with HVS analysis. 

28. A method as claimed in claim 26, wherein said digital 
information is a noise-like watermark. 

29. A method as claimed in claim 26, wherein the select- 
ing step is determined in accordance with HVS analysis and 
a user's selection. 

30. Amethod of embedding digital information in a digital 
image, wherein said method includes the following steps: 

partitioning the image into blocks of pixels; 

clustering the partitioned blocks into classes according to 
a homogeneity criteria; 

selecting one or more of the clusters in accordance with 
HVS analysis; 

generating an associated Karhunen-Loeve (K-L) trans- 
form for each selected cluster, 

wherein the image blocks of each selected cluster are used 
as a vector population for the purposes of generating 
the associated K-L transform; 

applying the associated K-L transform to the image blocks 
of the selected cluster to produce corresponding trans- 
formed image blocks; 

embedding, for each selected cluster, the digital informa- 
tion in the selected transformed image blocks; and 

applying, for each selected cluster, an inverse transform of 
the associated K-L transform to the embedded trans- 
form image blocks of the selected cluster. 
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31. A method as claimed in claim 30, wherein said digital 
information is embedded in the first L ; coefficients of the 
transformed image blocks, where the number L { is deter- 
mined in accordance with HVS analysis. 

32. A method as claimed in claim 30, wherein said digital 
information is a noise-like watermark. 

33. A method as claimed in claim 30, wherein the select- 
ing step is determined in accordance with HVS analysis and 
a user's selection. 

34. A method of embedding digital information in a digital 
image, wherein said method includes the following steps: 

partitioning the image into blocks of pixels; 

clustering the partitioned blocks into classes according to 
a homogeneity criteria; 

selecting one or more of the clusters in accordance with 
HVS analysis; 

generating an associated Karhunen-Loeve (K-L) trans- 
form for each selected cluster, wherein the image 
blocks of each selected cluster are used as a vector 
population for the purposes of generating the associated 
K-L transform; 

applying the associated K-L transform to the image blocks 
of the selected cluster to produce corresponding trans- 
formed image blocks; 

selecting, for each selected cluster, either the associated 
K-L transform or its corresponding transformed image 
blocks for embedding; 

embedding, for each selected cluster, the digital informa- 
tion in the selected K-L transform or the selected 
transformed image blocks; 

applying, for those selected clusters in which the digital 
information has been embedded in the associated K-L 
transform, an inverse transform of the embedded asso- 
ciated K-L transform to the transformed image blocks 
of the selected cluster; and 

applying, for those selected clusters in which the digital 
information has been embedded in the transformed 
image blocks, an inverse transform of the associated 
K-L transform to the embedded transform image blocks 
of the selected cluster. 

35. A method as claimed in claim 34, wherein said digital 
information is embedded in the first L ( - eigenvectors of the 
Karhunen-Loeve transforms, where the number L t - is deter- 
mined in accordance with HVS analysis. 

36. A method as claimed in claim 34, wherein said digital 
information is embedded in the first L f coefficients of the 
transformed image blocks, where the number L, is deter- 
mined in accordance with HVS analysis. 

37. A method as claimed in claim 34, wherein said digital 
information is a noise-like watermark. 

38. A method as claimed in claim 34, wherein the select- 
ing step is determined in accordance with HVS analysis and 
a user's selection. 

39. A method of embedding digital information in a 
plurality of images, wherein the images are stored and 
classified into one or more classes and said method includes 
the following steps: 

generating one or more transforms from the images of 
said respective one or more classes, wherein said 
transforms are dependent on the images; 

generating transformed images by applying the one or 
more transforms to the images of said respective one or 
more classes; 

embedding the digital information in the transformed 
images; and 
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generating the images data embedded with the digital 
information by applying one or more inverse trans- 
forms of the one or more transforms to the embedded 
transformed images; 

wherein said one or more transforms are Karhunen-Loeve 
transforms and said digital information is embedded in 
the first L,- coefficients of the transformed digital mul- 
timedia data, where the number L ( is determined in 
accordance with HVS analysis. 

40. A method of embedding digital information in a 
plurality of images, wherein the images are stored and 
classified into one or more classes and said method includes 
the following steps: 

generating one or more transforms from the images of 
said respective one or more classes, wherein said 
transforms are dependent on the images; 

generating transformed images by applying the one or 
more transforms to the images of said respective one or 
more classes; 

embedding the digital information in the one or more 
transforms or their inverses; and 

generating the images embedded with the digital infor- 
mation by applying one or more embedded inverse 
transforms to the transformed images. 

41. A method of embedding digital information into video 
images including a plurality of frames, wherein said method 
includes the following steps: 

extracting one or more key frames from the video images; 

generating one or more transforms from the key frames or 
a part thereof, wherein said transforms are dependent 
on the key frames or the part thereof; 

generating transformed key frames or part thereof by 
applying the one or more transforms to the key frames 
or the part thereof; 

embedding the digital information in the transformed key 
frames or part thereof; and 

generating the key frames or part thereof embedded with 
the digital information by applying one or more inverse 
transforms of the one or more transforms to the embed- 
ded key frames or part thereof; 

wherein said one or more transforms are Karhunen-Loeve 
transforms and said digital information is embedded in 
the first L { coefficients of the transformed digital mul- 
timedia data, where the number L ( - is determined in 
accordance with HVS analysis. 

42. Amethod of embedding digital information into video 
images including a plurality of frames, wherein said method 
includes the following steps: 

extracting one or more key frames from the video images; 

generating one or more transforms from the key frames or 
a part thereof, wherein said transforms are dependent 
on the key frames or the part thereof; 

generating transformed key frames or part thereof by 
applying the one or more transforms to the key frames 
or the part thereof; 

embedding the digital information in the one or more 
transforms or their inverses; and 

generating the key frames or part thereof embedded with 
the digital information by applying one or more embed- 
ded inverse transforms to the transformed key frames 
or part thereof. 

43. A method of modifying a first image in accordance 
with an image signature, wherein the image signature 
includes encrypted key points of a second image and their 
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invariant attributes and other aligned global information of 
the second image and the method includes the steps of: 

decrypting the image signature to obtain the key points 
and their invariant attributes and other global informa- 
tion of the second image; 

extracting key points and their invariant attributes from 
the first image; extracting other global information 
from the first image; 

matching the key points and their invariant attributes and 
other global information of the first and second images; 
and 

normalising the first image based on said matched key 
points and their invariant attributes and other global 
information. 

44. An apparatus for embedding digital information in 
digital multimedia data, wherein said apparatus includes: 

means for generating one or more transforms from the 
digital multimedia data or a portion of the digital 
multimedia data, wherein said transforms are depen- 
dent on the digital multimedia data or the portion of the 
digital multimedia data; 

means for generating transformed digital multimedia data 
by applying the one or more transforms to the digital 
multimedia data or the portion of the digital multimedia 
data; 

means for embedding the digital information in the trans- 
formed digital multimedia data; and 

means for generating the digital multimedia data embed- 
ded with the digital information by applying one or 
more inverse transforms of the one or more transforms 
to the embedded transformed digital multimedia data 

wherein said digital multimedia data is an image and said 
one or more transforms are Karhunen-Loeve trans- 
forms and said digital information is embedded in the 
first L, coefficients of the transformed digital multime- 
dia data, where the number L t - is determined in accor- 
dance with HVS analysis. 

45. An apparatus for embedding digital information in 
digital multimedia data, wherein said apparatus includes: 

means for generating one or more transforms from the 
digital multimedia data or a portion of the digital 
multimedia data, wherein said transforms are depen- 
dent on the digital multimedia data or the portion of the 
digital multimedia data; 

means for generating transformed digital multimedia data 
by applying the one or more transforms to the digital 
multimedia data or the portion of the digital multimedia 
data; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the digital multimedia data embed- 
ded with the digital information by applying one or 
more embedded inverse transforms to the transformed 
digital multimedia data. 

46. An apparatus for embedding digital information in a 
digital image, wherein said apparatus includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
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vector population for the purposes of generating the 
associated K-L transform; 
means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks. 

47. An apparatus for embedding digital information in a 
digital image, wherein said apparatus includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 

means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 

means for embedding, for each selected cluster, the digital 
information in the selected transformed image blocks; 
and 

means for applying, for each selected cluster, an inverse 
transform of the associated K-L transform to the 
embedded transform image blocks of the selected clus- 
ter. 

48. An apparatus for embedding digital information in a 
digital image, wherein said apparatus includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 

means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 

means for selecting, for each selected cluster, either the 
associated K-L transform or its corresponding trans- 
formed image blocks for embedding; 

means for embedding, for each selected cluster, the digital 
information in the selected K-L transform or the 
selected transformed image blocks; 

means for applying, for those selected clusters in which 
the digital information has been embedded in the 
associated K-L transform, an inverse transform of the 
embedded associated K-L transform to the transformed 
image blocks of the selected cluster; and 

means for applying, for those selected clusters in which 
the digital information has been embedded in the 
transformed image blocks, an inverse transform of the 
associated K-L transform to the embedded transform 
image blocks of the selected cluster. 

49. An apparatus for embedding digital information in a 
plurality of images, wherein the images are stored and 
classified into one or more classes and said apparatus 
includes: 

means for generating one or more transforms from the 
images of said respective one or more classes, wherein 
said transforms are dependent on the images; 
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means for generating transformed images by applying the 
one or more transforms to the images of said respective 
one or more classes; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the images embedded with the 
digital information by applying one or more embedded 
inverse transforms to the transformed images. 

50. An apparatus for embedding digital information into 
video images including a plurality of frames, wherein said 
apparatus includes: 

means for extracting one or more key frames from the 
video images; 

means for generating one or more transforms from the key 
frames or a part thereof, wherein said transforms are 
dependent on the key frames or the part thereof; 

means for generating transformed key frames or part 
thereof by applying the one or more transforms to the 
key frames or the part thereof; 

means for embedding the digital information in the trans- 
formed key frames or part thereof; and 

means for generating the key frames or part thereof 
embedded with the digital information by applying one 
or more inverse transforms of the one or more trans- 
forms to the embedded key frames or part thereof; 

wherein said one or more transforms are Karhunen-Loeve 
transforms and said digital information is embedded in 
the first Lf coefficients of the transformed digital mul- 
timedia data, where the number L t is determined in 
accordance with HVS analysis. 

51. An apparatus for embedding digital information into 
video images including a plurality of frames, wherein said 
apparatus includes: 

means for extracting one or more key frames from the 
video images; 

means for generating one or more transforms from the key 
frames or a part thereof, wherein said transforms are 
dependent on the key frames or the part thereof; 

means for generating transformed key frames or part 
thereof by applying the one or more transforms to the 
key frames or the part thereof; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the key frames or part thereof 
embedded with the digital information by applying one 
or more embedded inverse transforms to the trans- 
formed key frames or part thereof. 

52. An apparatus for modifying a first image in accor- 
dance with an image signature, wherein the image signature 
includes encrypted key points of a second image and their 
invariant attributes and other aligned global information of 
the second image and the apparatus includes: 

means for decrypting the image signature to obtain the 
key points and their invariant attributes and other 
global information of the second image; 

means for extracting key points and their invariant 
attributes from the first image; 

means for extracting other global information from the 
first image; 

means for matching the key points and their invariant 

attributes and other global information of the first and 

second images; and 
means for normalising the first image based on said 

matched key points and their invariant attributes and 

other global information. 
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53. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in digital multime- 
dia data, wherein said computer program product includes: 

means for generating one or more transforms from the 
digital multimedia data or a portion of the digital 
multimedia data, wherein said transforms are depen- 
dent on the digital multimedia data or the portion of the 
digital multimedia data; 

means for generating transformed digital multimedia data 
by applying the one or more transforms to the digital 
multimedia data or the portion of the digital multimedia 
data; 

means for embedding the digital information in the trans- 
formed digital multimedia data; and 

means for generating the digital multimedia data embed- 
ded with the digital information by applying one or 
more inverse transforms of the one or more transforms 
to the embedded transformed digital multimedia data; 

wherein said digital multimedia data is an image and said 
one or more transforms are Karhunen-Loeve trans- 
forms and said digital information is embedded in the 
first L f coefficients of the transformed digital multime- 
dia data, where the number h { is determined in accor- 
dance with HVS analysis. 

54. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in digital multime- 
dia data, wherein said computer program product includes: 

means for generating one or more transforms from the 
digital multimedia data or a portion of the digital 
multimedia data, wherein said transforms are depen- 
dent on the digital multimedia data or the portion of the 
digital multimedia data; 

means for generating transformed digital multimedia data 
by applying the one or more transforms to the digital 
multimedia data or the portion of the digital multimedia 
data; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the digital multimedia data embed- 
ded with the digital information by applying one or 
more embedded inverse transforms to the transformed 
digital multimedia data. 

55. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in a digital image, 
wherein said computer program product includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 

means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 

means for embedding, for each selected cluster, the digital 
information in the associated K-L transform; and 

means for applying, for each selected cluster, an inverse 
transform of the embedded associated K-L transform to 
the transformed image blocks of the selected cluster. 
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56. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in a digital image, 
wherein said computer program product includes: 

means for partitioning the image into blocks of pixels; s 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve io 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 

means for applying the associated K-L transform to the 15 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 

means for embedding, for each selected cluster, the digital 
information in the selected transformed image blocks; 
and 20 

means for applying, for each selected cluster, an inverse 
transform of the associated K-L transform to the 
embedded transform image blocks of the selected clus- 
ter. 

57. A computer program product including a computer 25 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in a digital image, 
wherein said computer program product includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 30 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 35 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 

means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 

means for selecting, for each selected cluster, either the 
associated K-L transform or its corresponding trans- 
formed image blocks for embedding; 45 

means for embedding, for each selected cluster, the digital 
information in the selected K-L transform or the 
selected transformed image blocks; 

means for applying, for those selected clusters in which 
the digital information has been embedded in the 50 
associated K-L transform, an inverse transform of the 
embedded associated K-L transform to the transformed 
image blocks of the selected cluster; and 

means for applying, for those selected clusters in which 
the digital information has been embedded in the 55 
transformed image blocks, an inverse transform of the 
associated K-L transform to the embedded transform 
image blocks of the selected cluster. 

58. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 60 
gram for embedding digital information in a plurality of 
images, wherein the images are stored and classified into one 

or more classes and said computer program product 
includes: 

means for generating one or more transforms from the 65 
images of said respective one or more classes, wherein 
said transforms are dependent on the images; 



means for generating transformed images by applying the 
one or more transforms to the images of said respective 
one or more classes; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the images embedded with the 
digital information by applying one or more embedded 
inverse transforms to the transformed images. 

59. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information into video images 
including a plurality of frames, wherein said computer 
program product includes: 

means for extracting one or more key frames from the 
video images; 

means for generating one or more transforms from the key 
frames or a part thereof, wherein said transforms are 
dependent on the key frames or the part thereof; 

means for generating transformed key frames or part 
thereof by applying the one or more transforms to the 
key frames or the part thereof; 

means for embedding the digital information in the trans- 
formed key frames or part thereof; and 

means for generating the key frames or part thereof 
embedded with the digital information by applying one 
or more inverse transforms of the one or more trans- 
forms to the embedded key frames or part thereof; 

wherein said one or more transforms are Karhunen-Loeve 
transforms and said digital information is embedded in 
the first L,- coefficients of the transformed digital mul- 
timedia data, where the number L t - is determined in 
accordance with HVS analysis. 

60. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information into video images 
including a plurality of frames, wherein said computer 
program product includes: 

means for extracting one or more key frames from the 
video images; 

means for generating one or more transforms from the key 
frames or a part thereof, wherein said transforms are 
dependent on the key frames or the part thereof; 

means for generating transformed key frames or part 
thereof by applying the one or more transforms to the 
key frames or the part thereof; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the key frames or part thereof 
embedded with the digital information by applying one 
or more embedded inverse transforms to the trans- 
formed key frames or part thereof. 

61. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for modifying a first image in accordance with an 
image signature, wherein the image signature includes 
encrypted key points of a second image and their invariant 
attributes and other aligned global information of the second 
image and the computer program product includes: 

means for decrypting the image signature to obtain the 
key points and their invariant attributes and other 
global information of the second image; 

means for extracting key points and their invariant 
attributes from the first image; 

means for extracting other global information from the 
first image; 
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means for matching the key points and their invariant 

attributes and other global information of the first and 

second images; and 
means for normalizing the first image based od said 

matched key points and their invariant attributes and 

other global information. 

62. A method as claimed in claim 34, further comprising 
registering the image including the following steps: 

extracting key points from the image and their invariant 
attributes; 

extracting other global information from the image; 
aligning the extracted key points and their invariant 

attributes with the global information; and 
encrypting the aligned information to provide an image 

signature. 

63. An apparatus as claimed in claim 48, further com- 
prising means for registering the image including: 

means for extricating key points from the image and their 

invariant attributes; 
means for extracting other global information from the 

image; 

means for aligning the extracted key points and their 
invariant attributes with the global information; 

means for encrypting the aligned information to provide 
an image signature. 

64. A computer program product as claimed in claim 56, 
in which the computer program registers the image and 
includes: 

means for extracting key points from the image and their 

invariant attributes; 
means for extracting other global information from the 

image; 

means for aligning the extracted key points and their 
invariant attributes with the global information; 

means for encrypting the aligned information to provide 
an image signature. 

65. A method as claimed in claim 39, further comprising 
modifying a first image in accordance with an image 
signature, wherein the image signature includes encrypted 
key points of a second image and their invariant attributes 
and other aligned global information of the second image, 
wherein said modifying the first image includes the steps of: 

decrypting the image signature to obtain the key points 
and their invariant attributes and other global informa- 
tion of the second image; 

extracting key points and their invariant attributes from 
the first image; 

extracting other global information from the first image; 

matching the key points and their invariant attributes and 
other global information of the first and second images; 
and 

normalising the first image based on said matched key 
points and their invariant attributes and other global 
information. 

66. An apparatus as claimed in claim 49, further com- 
prising means for modifying a first image in accordance with 
an image signature, wherein the image signature includes 
encrypted key points of a second image and their invariant 
attributes and other aligned global information of the second 
image, said means for modifying including: 

means for decrypting the image signature to obtain the 
key points and their invariant attributes and other 
global information of the second image; 

means for extracting key points and their invariant 
attributes from the first image; 
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means for extracting other global information from the 
first image; 

means for matching the key points and their invariant 
attributes and other global information from the first 
image; and 

means for normalising the first image based on said 
matched key points aod their invariant attributes and 
other global information. 

67. A computer program product as claimed in claim 60, 
including: 

means for modifying the image in accordance with the 
image signature; wherein the image signature includes 
encrypted key points of a second image and their 
invariant attributes and other aligned global informa- 
tion of the second image, said means for modifying 
including: 

means for decrypting the image signature to obtain the 
key points and their invariant attributes and other 
global information of the second image; 

means for extracting key points and their invariant 
attributes from the first image; 

means for extracting other global information from the 
first image; 

means for matching the key points and their invariant 
attributes and other global information of the first 
image based on said matched key points and their 
invariant attributes and other global information. 

68. A method as claimed in claim 12, further comprising: 
extracting digital information from first digital multimedia 
data having embedded therein said digital information 
including the following steps: 

deriving one or more embedded transforms from a refer- 
ence file, wherein said embedded transforms are depen- 
dent on second digital multimedia data or a portion 
thereof; 

deriving transformed digital multimedia data from the 
reference file, wherein said transformed digital multi- 
media data is dependent on the second digital multi- 
media data or a portion thereof; 

generating transformed digital multimedia data by apply- 
ing one or more of the derived embedded transforms to 
the first digital multimedia data or a portion thereof; 
and 

correlating the generated transformed digital multimedia 
with the derived transformed digital multimedia to 
check whether the digital information embedded in the 
first multimedia data is the same as that derived from 
the reference file. 

69. A method as claimed in claim 12, further comprising 
extracting digital information from first digital multimedia 
data having embedded therein said digital information, 
including the following steps: 

deriving one or more transforms from a reference file, 
wherein said transforms are dependent on second digi- 
tal multimedia data or a portion thereof; 

deriving transformed digital multimedia data from the 
reference file, wherein said transformed digital multi- 
media data is dependent on the second digital multi- 
media data or a portion thereof; 

generating embedded transformed digital multimedia data 
by applying one or more of the derived embedded 
transforms to the first digital multimedia data or a 
portion thereof; and 

correlating the generated embedded transformed digital 
multimedia with the derived transformed digital mul- 
timedia so as to extract the digital information. 
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70. An apparatus as claimed in claim 49, further com- 
prising means for extracting digital information from first 
digital multimedia data having embedded therein said digital 
information, including: 

means for deriving one or more embedded transforms 
from a reference file, wherein said embedded trans- 
forms are dependent on second digital multimedia data 
or a portion thereof; 

means for deriving transformed digital multimedia data 
from the reference file, wherein said transformed digi- 
tal multimedia data is dependent on the second digital 
multimedia data or a portion thereof; 

means for generating transformed digital multimedia data 
by applying one or more of the derived embedded 
transforms to the first digital multimedia data or a 
portion thereof; and 

means for correlating the generated transformed digital 
multimedia with the derived transformed digital mul- 
timedia to check whether the digital information 
embedded in the first multimedia data is the same as 
that derived from the reference file. 

71. A computer program product as claimed in claim 60, 
including means extracting digital information from first 
digital multimedia data having embedded therein said digital 
information, including: 

means for deriving one or more embedded transforms 
from a reference file, wherein said embedded trans- 
forms are dependent on second digital multimedia data 
or a portion thereof; 

means for deriving transformed digital multimedia data 
from the reference file, wherein said transformed digi- 
tal multimedia data is dependent on the second digital 
multimedia data or a portion thereof; 

means for generating transformed digital multimedia data 
by applying one or more of the derived embedded 
transforms to the first digital multimedia data or a 
portion thereof; and 

means for correlating the generated transformed digital 
multimedia with the derived transformed digital mul- 
timedia to check whether the digital information 
embedded in the first multimedia data is the same as 
that derived from the reference file, having embedded 
therein said digital information, wherein said computer 
program product includes: 

means for partitioning the image into blocks of pixels; 
means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 
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means for selecting one or more of the clusters in 
accordance with information obtained from a refer- 
ence file; 

means for retrieving, for each selected cluster, an 
average block of pixels stored in the reference file; 
means for averaging, for each selected cluster, the 

blocks of pixels of the image; and 
means for correlating, for each selected pixel, the 
averaged blocks of the image with the retrieved 
blocks to determine whether a watermark exists. 
72. A method of embedding digital information in a 
plurality of images, wherein the images are stored and 
classified into one or more classes and said method includes 
the following steps: 
generating one or more transforms from the images of 
said respective one or more classes, wherein said 
transforms are dependent on the images; generating 
transformed images by applying the one or more trans- 
forms to the images of said respective one or more 
classes; 

embedding the digital information in the transformed 
images; 

generating the images data embedded with the digital 
information by applying one or more inverse trans- 
forms of the one or more transforms to the embedded 
transformed images; and 
modifying a first image in accordance with an image 
signature, wherein the image signature includes 
encrypted key points of a second image and their 
invariant attributes and other aligned global informa- 
tion of the second image, wherein said modifying the 
first image includes the steps of: 
decrypting the image signature to obtain the key points 
and their invariant attributes and other global infor- 
mation of the second image; 
extracting key points and their invariant attributes from 
the first image; extracting other global information 
from the first image; 
matching the key points and their invariant attributes 
and other global information of the first and second 
images; and 

normalising the first image based on said matched key 
points and their invariant attributes and other global 
information. 
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